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ABSTRACT 



Seventy-two scales collected from a previous study were admin- 
istered to a group of 557, sixth grade, Philadelphia public school child 
ren who were mainly from the lower socioeconomic class. A matrix sampl- 
ing approach was used in collecting the data. The mean value for each 
scale was established and these values were correlated. The resulting 
72 x 72 matrix was factor analyzed using the Principal Components method 
with Varimax rotation of five factors. The five factors accounted for 
33% of the variance. Comparisons were made with previous studies. 



I lit lllllllt'l l*l)t 

The purpose of the development of the Semantic Differential 
was to obtain a quantitative index of meaning (Osgood, Suci and Tannen- 
baum, 1957) . since the technique used verbal encoding, it was necessary 
to develop "a carefully devised sample of alternative verbal responses 
which can be standardized across subjects ...(and which will be) repre- 
sentative of the major ways in which meanings vary [Osgood, Suci and 
Tannenbaum, 1957, p.19]." As Osgood, et al. pointed out in the same 
volume, the sampling of subjects, on the basis of which the scales were 
devised, was somewhat inadequate since the subjects were mostly college 
undergraduates . 

It has been contended (McNamara, Ayrer and Farber, 1972) that 
scales developed on such a population might lead to an increase in error 
variance if used with elementary school children since the scales used 
are not typical of their lar guage patterns. They would therefore be asked 
to rate a set of concepts wi th scales consisting of adjectives which they 
would not normally use to dc scribe them. Furthermore, there is evidence 
from sociolinguistics (Bernstein, 1965, 1971? Robinson and Creed, 1968? 
Lawton, 1963? Raph, 1967) wl ich indicates that lower socioeconomic class 
children have a language the t differs from middle class children of the 
same age. This could further increase the error. 

It was for these reasons that it was decided to develop a set 
of scales based upon the lar guage patterns of elementary school children 
such as those that are found in the Philadelphia schools. Di Vesta, in 
two previous papers (1965, 1966), had developed scales on a sample of 
elementary school children which he described as middle socioeconomic. 

The Philadelphia school population, although varied, is primarily of lower 
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socioeconomic status and replication seemed justified because of this 
difference . 

Any attempt to apply the Semantic Differential Technique to a 
new group for whom it is felt that established scales may not be appro- 
priate requires, in addition to the development of the scales, a factor 
analysis of them. This is necessary since, if the desired index of mean- 
ing of the concept is to be of any value, it must reflect the score of 
that group on all of the basic dimensions of meaning. Osgood recognized 
this and The Measurement of Meaning (Osgood, Suci and Tanrenbaum, 1957) 
included a number of factor analytic studies in which there nad been an 
attempt to determine the dimensionality of semantic space. In these 
studies the basic EPA - EvaJuative, Potency, Activity - dimensions emerged. 
The Evaluative factor regularly appeared first and accounted for one-half 
to three-quarters of the extractable variance. It was defined by such 
scales as good-bad, sweet-sour, kind-cruel and beautiful -ugly . The 
Potency factor appeared second and accounted for about half as much variance 
as the firsrt:. It was defined by large-small, strong-weak and heavy-light. 
The Activity factor appeared third and accounted for about the same amount 
of variance as the second factor. It was defined by fast-slow, active- 
passive, and sharp-dull. Several other factors appeared in one or another 
of the studies and were defined as a stability, a tautness, a novelty and 
a receptivity factor. 

Heise (1969) reviewed a number of studies in which the EPA 
structure showed up consistently including samples of schizophrenics, 
navy enlistees and men and women of various socioeconomic status. 

Osgood, Minon and Archer (1962) had high school students rate 
100 concepts on 50 scales. They found E (45% of the variance), P (12%) 
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and A (6%) . 



Tanaha and Osgood (1965) were able to demonstrate the EPA 
structure in a study in which the scales were used to rate lines and 
forms instead of verbal concepts. 

In studies with eJementary school children, Lilly (1966) had 
his parochial school subjects rate 20 concepts on 28 scales. He found 
EPA and Novelty and Stability. Di Vesta (1966) reported 3 separate 
factor analyses of 37 scales used to rate 20 concepts by pupils in 
grades 2-6. In the first analysis E, P and A accounted for 41%, 16 
and 12% of the variance while a Dynamism factor accounted for 10%. The 
defining scales were virtually the same as Osgood's. In the second 
analysis, E, P and A also appeared along with Warmth, Tautness and Novelty- 
Reality but E accounted for only about 20% of the total variance. 



Method 

General Considerations 

One of the problens in factor analytic work with the semantic 
differential is the need for a wide variety of concepts. The reason for 
the factor analysis is to determine the basic dimensions along which 
meaning varies. Obviously, if only one concept type is used, the opportu- 
nity for many dimensions to appear is restricted. Imagine using the 
Semantic Differential to rate paintings. The Evaluative factor would 
appear and, in fact, might be broken into a few E type factors but it 

•i . 

would be difficult to got Par A. As a result, Heise (1969), for example, 
recommended that five concepts be used for each of the eight possible 
combinations of EPA: E+P+A+, E+P+A-, E+P - A~, ..., E“P**A“ . This would 

mean 40 concepts as a minimum. Since there were 72 scales to factor 
analyze and it is desirable to have about four times as many subjects as 
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variables, it would bo necessary to have 40 x 72 = 2880 responses from 
o.irli of U)0 hi ib If if Lakes five minutes to rate four concepts on 

nine scales it would take about six to seven hours to rate 40 concepts 
on 72 scales. It is difficult to imagine a principal saying yes to such 
a request (much less maintaining the pupil J^s) interest) . It was there- 
fore decided to use a matrix sampling approach. 

Matrix Sampling . Any set of testing data can be visualized as appear- 
ing in a subject by item matrix. It has been shown by Lord (1962), Shoe- 
maker (1970a, 1970b, 1971) and others that results obtained from random 
sampling of both items and subjects from the matrix are virtually the same 
as those that would be obtained if all subjects responded to all items. 
Therefore, instead of giving 100 items to each of 100 people as in the 
traditional method, the 100 items are randomly assigned to ten-ten item 
tests and one of these tests is assigned to a randomly selected group of 
ten people. 

This is a somewhai unusual approach so some justification is 
provided here. In factor analysis with semantic differential data, there 
are three sources of variance: scales, concepts, and subjects. In work 

of the nature described in this paper, it is standard procedure to sum 
across concepts, leaving a scale or item by subject matrix. 

In this research, the scales were randomly assigned to groups 
of nine scales each - called scale packages. The order and polarity of 
each scale was randomly determined. The scale packages were randomly 
assigned to concepts. The concepts were randomly assigned to response 
forms and the response forms were randomly collated into groups of four. 

This means that any subject could have been assigned any combination of 
scales and thus each correlation should be representative of the correlation 
that would have been obtained if all students had responded to all scales. 



The 72 scales used in the study came from a previous study by 
McNamara* Ayrer and Farber (1972) . Of the 72 scales* 25 also appeared 
in the Measurement of Meaning (Osgood, Suci and Tannenbaum, 1957) and/ 
or in Di Vesta's (1966) work. The scales were assigned to eight scale 
packages. The scales are listed in Table 1. 

Insert Table 1 Here 

Concepts 

In order to obtain covariance terms across all eight scale 

packages (made necessary by the matrix sampling approach) * it was necessary 

l 

to have n(n -l)/*' = 28 pairings of scale packages. 

It was decided to have each scale package pair appear twice on 
any one response sheet so it was necessary to have 28 different response 
sheets. Since there are four concepts to each response sheet* 112 con- 
cepts were necessary. Of these 50 came from the previous study* and 
the remainder were selected for study. They were selected to be repre- 
sentative of the pupil^/^ total life space. They are shown in Table 2 
along with the scale packages assigned to them. 

Insert Table 2 Here 

Adminis tration 

It was decided that a reasonable task for sixth grade subjects 
would be to have them rate 16 concepts (four pages) . 

A five-point semantic differential was used. Standard Osgood 
directions were used and modified for the sixth graders. 

The examiners were the authors and two associates who had been 



trained to administer the instruments 



Subjects 



The subjects were 557 sixth grade pupils chosen to be represen- 
tative of Philadelphia elementary school pupils. Of the total about 70% 
would be considered lower socioeconomic class while the remainder were 
closer to middle class. 

Analysis 

A program was written to unscramble the responses and compute 
mean scores for each scale for each subject. These mean scores were 
submitted to BMD 03D (Dixon, 1964), a correlation program which 

allows for deletion of certain item values. In this case, blanks and 
zeroes were omitted. The resulting 72 x 72 matrix was factor analyzed 
using the Principal Components technique with unity in the diagonal. 

The Varimax criterion was used in rotation. 

Results 

In keeping with the exploratory nature of the study, in the 
first analysis, the computer was instructed to extract and rotate 8 factors 
or until an eigenvalue of .500 was reached. The results are shown in 
Table 3. Scales with loadings less than .40 are not included. 

Insert Table 3 Here 

The first factor (in fact, the first two factors) , seemed to 
be evaluative, but only accounted for 11% of the variance. This is far 
less than one would expect. Another disturbing factor was that there 
were 26 eiginvalues greater than 1.0. 

This gave rise to doubts about the use of the matrix sampling 
approach, in order to see what effect this might have had, it was decided 
to run a second set of factor analyses in which only those variables to 
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which everyone in subsets of the total sample ha^ responded were factor 
analyzed. With four pages per respondent, it would have been possible 
to have a maximum of eight scale packages. As it turned out, 142 subjects 
had responded it) scale pad ages !, 1, *», anti 7; another 14o to 1 > 3, 7, 

and H; 14') to 2, 4, 5, and 6 s 86 to 2, 3, 4, and 8» 79 to 1, 5, 6, and 8. 
If the matrix sampling approach had been responsible, the percentage of 
variance accounted for by the first three factors and the ratio of number 
of eiginvalues greater than 1.0 divided by number of variables should 
differ. Table 4 shows the results of those comparisons. 

Insert Table 4 Here 

The number of eiginvalues greater than 1.0 is also consistent 
with a previous study with 155 ninth grade Philadelphia pupils by one 
of the authors (Ayrer, 1972) in which 40 scales were factor analyzed 
and there were 14 eiginvaluas greater than 1.0. 

In addition, substantial similarity in factor structure was 
observed across the separate factorings. 

This brief analysis corroborated the results of the 72 variable 
analysis and supported the conclusion that factor analysis based upon a 
matrix sampling approach wa3 legitimate. 

In Principal Components analysis, the dimensionality equals the 
order of the matrix and it is up to the investigator to determine which 
factors are meaningful and vhen to stop extracting. The usual rule of 
thumb is to stop when the eiginvalues drop below 1.0. In this case there 
were 26 eiginvalues greater than 1.0, a number which is too large for 
effective interpretation. Another technique which can be used in this 
case is Cattell's Scree Tests the factors are plotted against the percen- 
tage of variance for which the factor accounts. The curve flattens out. 



according to Cattell, when the factors are largely accounting for random 
error (Cattell , 1966) . When this test was applied to the data, it was 
decided to factor analyze a second time and stop rotating after five 
factors. The Eiginvalues of this matrix and the cumulative amount of 
variance extracted is shown in Table 5. 

Insert Table 5 Here 

The results of this second factor analysis are shown in 

Table 6. 

Insert Table 6 Here 

Of the 72 original scales, 42 had loadings of at least .40 
on one of the five factors. Of the remaining 30, 10 are standard Osgood 
scales. This is not to say they are not worthwhile with such a population. 
Of the 10, 7 had loadings of greater than .40 on the initial, eight factor, 
solution, and the remaining three would have been included if the criterion 
had been .30 or better. 

Discussion 

This study had two basic purposes; (1) determining the dimen- 
sionality of the semantic space underlying the 72 scales and (2) deter- 
mining which scales were the best measures of each dimension. Also of 
interest was a comparison of the findings of this study with those of 
Osgood, Suci and Tannenbaum (1957) and Di Vesta (1966) . 

Using the five-factor solution as the basis for this discussion, 
the results are different from most other studies the authors have seen. 

In most studies, the first three factors extracted ara E f P, and A .and 
they account for about 50% of the variance. This is cer\*:inly true for 
Osgood's reported studies and Di Vesta's. 



In this study, the Evaluative dimension seems to split in two, 
the first two factors being clearly Evaluative. The first factor seems 
to involve character is Lies of other peoples ugly-handsome, ugly-beautiful# 
ugly-cute, rough-gentle, tiny-huge, strict-nice. The second factor seems 
to involve feeling relating to seifs good-bad, angry-happy# comfortable- 
uncomfortable, sweet-sour, dumb-smart, weak-muscular. 

Factor three is either Potency or, given the high loading for 
cold-warm may be Dynamism: a factor sometimes found (Di Vesta, 1966) 

which is a combination of Activity and Potency. 

Factor four is another Evaluative factor but one which seems 
to involve a concern for Personal Safety: safe-dangerous, unhealthy- 

healthy, unkind-kind, unfriendly-friendly, etc. 

Factor five seems to be a spillover factor. Its highest load- 
ings are with dumb-intelligent, exciting-boring, and mean-nice: three / 

scales which can be considered E or P depending on whether one sees them 
as conferring power on others or simply as characteristics of another , 

human being. In addition, cowardly-brave, rough-smooth, and young-old, V 

all load on at least EP if not EP and A. Moreover, seven of the ten 
scales have loadings between .40 and .50 allowing the hypothesis that 
they are the type of scale tfhich is neither fish nor fowl and gets stuck 
between dimensions in rotation. 

Under ordinary conditions, one would probably not venture too 
many opinions about these factors and their interpretation, but given 
the developmental and heuristic nature of this study, a few comments do 
not seem out of order. Pupils of this age are becoming very peer-oriented 
but, at the same time, are still quite under the dominance of adults. 

They are therefore very concerned about how other people are relating to 
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them and their view of the world is dominated by such things as looks, 
size, and how people are treating them. The self-image is very fragile 
at this point. They are also beginning to feel the stirrings of a drive 
for independence - the need to have some power in deciding what will 
happen to them. Finally, for many Philadelphia children, the question 
of their own personal safety is a real consideration and part of their 
view of the world must be filtered through that screen. It will be interest- 
ing to see if these findings are replicated in other big cities. 

The number of eiginvalues greater than 1.0 and the proportion 
of variance extracted was, as mentioned previously, a surprise, since 
most other studies which have been published show that E, P, and A account 
for much more variance than was found here. The only study that was 
found which was similar was presented by Evans at the 1971 AERA meeting. 

He had pupils from ten high schools in Ontario and their companion junior 
high schools use 60 scales to rate nouns. Evans found 10 factors with 
eiginvalues greater than 1.0 which, together, accounted for 40% of the 
variance. The first factor accounted for 18% of the variance and none 
of the remaining nine accounted for more than 4%. 

Given the consistency of these eiginvalue -cumulative variance 
results in this study and the previous study by Ayrer (1972) , the tendency 
is to suggest that this kind of a finding is typical of what will be found 
with subjects from large city school systems. Again, it is hoped there 
will be some attempts at replication. 

Finally, it should be pointed out that 28 of the 43 scales with 
loadings of .40 or better on the factors in this study came from the 
McNamara-Ayrer-Farber study previously reported. The implication is that 
a series of new scales has been created with known factorial composition 
which are more typical of the language of elementary school children. 
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Even if only those scales with loadings of .60 or better are used, the 
following are now available: good-awful , interesting-dull, ugly-cute, 

rough-gentle, angry-happy, comfortable-uncomfortable , dumb -smart , safe- 
dangerous, unkind-kind, unhealthy-healthy, dumb-intelligent, exciting- 
boring, and mean-nice. 

Further studies are to be carried out in grades 4, 7, and 8 to 
determine whether the findings in this study are consistent across grades. 
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TABLE 1. 



List of Seventy- two Scales Used In the Study 




-1 







Weak -St rong* 


High-Low. . (0) 


Smart -Dumb. 


5 




Col d -Hot* 


Bright-Dark. . (0) 


Smart-Stupid. 


; 




Good-Bad* 


Brave -Coward tv. . (0) 


Kt nd-Mean, 


| 




Fast-Slow* 


Loud-Soft. . (0) 


K1 nd-Unkind. 


i 

a 




Soft -Hard* 


Cold-Warm. 


Dul 1 -Colorful . 






Long -Short* 


Fat-Ski nny . 


Dul 1 -Bright. 


j 

4 




Dul 1 -Sharp* 


Strict-Nice. 


Loud-Quiet. 




Rough -Smooth* 


Mean-Nice. 


Awful -Wonderful . 






Sweet -Sour* 


Easy-Hard. 


Awful -Good. 


j 

i 




Black-White. . (0) 


Yel low-Green. 


Fat-Thin. 


i 




Beauti fui-Ugly. . (0) 


Blue -Green. 


Ang ry -Happy . 


■5 

i 




Red-Blue. . (D) 


Male-Female. 


Wide-Thin. 


1 

l 




Round-Square. . (D) 


Rough-Gentle. 


Unnecessary-Necessary. 


J 




Big-Little.. (D) 


Rough -Sof t. 


Warm-Cool . 


| 




Clean-Di rty. . (0) 


Bori ng-Exci t ing. 


Comfortable-Uncomfortable. 


* 




New-Old. . (D) 


Dull -Exciting. 


Dangerous -Safe. 


i 




Smal 1 -Large. . (0) 


Un interest Ing- Interest ing. 


Healthy-Sick. 


! 

{ 




Sad-Happy. . (0) 


Interest! ng-Dul 1 . 


Hea 1 thy-Unhea 1 t hy . 


i 

I 




Ugly-Pretty. . (D) 


Boring- Interest Ing. 


Muscular-Weak. 


\ 

■j 




Awful -Nice. . (0) 


Tall -Short. 


Noisy-Quiet. 


h 

q 


/ 


Wide-Narrow. . (0) 


Bi g-Smai 1 . 


Lovl ng-Hatl ng. 


1 

i 

■ 




Young-Old. . (0) 


Intel 1 igent-Dumb. 


Brave-Scared. 

Huge-Tiny. 

Huge-Smal 1 . 

Ugly-Handsome. 

Ugly-Cute. 

Friendly-Unfriendly. 
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^Appears In DI Vesta's (1966) and Osgood's (1957) Lists. 

.Appears only in this study. 

..Appears In DI Vesta's or Osgood's Lists. 

(Initials Indicate which.) 
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Concepts Used in This Study Arranged By Scale Package 



TABLE 3. 



Results of First Factrr Analysis 

Factor 

Scale Name 1 2 3 4 5 6 7 8 



Ugly-Cute 
Ugly-Beautiful 
Bright-Dark 
Interesting-Dul 1 
Awful -Good 
Rough-Gentle 
Wonderful -Awful 
Black-White 



.75 

.73 

-.67 

.62 

.59 

.51 

-.45 .48 

.41 



Good -Bad .84 
Comfortable-Uncomfortable .79 
Happy-Angry .79 
Dumb-Smart -.75 
Bright-Dull .66 
Sour-Sweet -.58 
Weak-Muscular -.47 

Cold-Warm .66 
Soft-Hard .61 
Small -Large .58 
Soft-Rough .52 
Thin-Fat .50 



Clean-Di rty 

Safe-Dangerous 

Unki nd-Ki nd 

Unhealthy-Healthy 

Unfriendly-Friendly 

Pretty-Ugly 

Exci ti ng-Dul 1 

New-Old 

Dumb- Intel 1 igent 



.71 

.71 

-.64 

-.63 

-.54 

.51 

.48 

.45 

-.44 .63 



Mean-Ni ce 
Exciting-Boring 
Square- Round 
Low-High 
Li ttle-Big 
Cowardly- Brave 
Rough-Smooth 



.63 

.62 

.48 

.46 

.44 

.43 

.42 



Long-Short 
Hard-Easy 
Narrow-Wide 
Smal 1-Huge 
Fat-Skinny 



.60 

.59 

-.58 

-.53 

.47 



/ 
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TABLE 3. (continued) 



Results of First Factor Analysis 

Factor 

Scale Name 1 2 3 4 5 6 7 8 



Ugly -Handsome .64 
Happy -Sad -.61 
Healthy-Sick -.58 
Uninteresting- Interesting .55 



Colorful -Dul 1 
Slow- Fast 
Ti ny-Huge 

Ni ce-Awful 
Dul 1 -Sharp 
Thi n-Wi de 
Mean-Ki nd 
Dul 1 -Bright 
Big-Smal 1 
Hating-Loving 

Eigenvalues 8.04 5*67 



-.51 

.48 

.46 

.62 

-.46 

.43 

-.43 

-.42 

.42 

-.40 

3.97 3.25 2.95 2.76 2.42 2.21 



Percent of Total Variance 

Extracted 11 



8 6 4 4 4 3 



3 
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TABLE 4 



Comparison of Eight Package and Four Package Analyses 



Percent of Variance Accounted No. of Eigenvalues >1 .0 
For By Factor 

Scale Packages 



Factor Analyzed 


1 


2 


3 


No. 


of Variabl 


1, 2, 3, 4, 5, 6, 7, 8 


11 


8 


5.5 


26 

72 


- 36% 


2, 3, 4, 8 


13 


11 


7.5 


12 

55“ 


» 33% 


2,'t,5,6 


17 


10 


7 


10 

3S 


• 28% 


1 .3,7,8 


15 


10 


7.5 


ii 

55* 


» 31% 


1, 3,6,7 


14.6 


9.2 


6.4 


12 

35* 


- 33% 


1 ,5,6,8 


15.7 


9.5 


8 


12 

55* 


= 33% 




o 
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TABLE 6. 



Results of Second Factor Analysts Wtth Rotation 
of Five Factors 



Scale Name 



Loading in Factor 

Previous Studies* 1 2 3 4 5 



1. 


Ugly-Beautiful 


2. 


Awful -Good 


3. 


Interesting-Dul 1 


4. 


Ugly-Cute 


5. 


Rough-Gentle 


6. 


Bright-Dark 


7. 


Dul 1-Bright 


8. 


Tiny-Huge 


9. 


Loud-Quiet 


10. 


Ugly-Handsome 


11. 


Strict-Nice 


12. 


Good -Bad 


13. 


Angry-Happy 


14. 


Comf ortab 1 e-Uncomf ortab 1 e 


15. 


Dumb-Smart 


16. 


Brlght-Dul 1 


17. 


Sour- Sweet 


18. 


Weak-Muscular 



E 


.75 




none 


.69 




none 


-.68 




none 


.68 




none 


.63 




E 


-.48 




none 


.46 




none 


.43 




none 


.43 




none 


.42 




none 


.40 




E 




.81 


none 




.76 


none 




.76 


none 




-.72 


none 




.64 


E 




-.55 


none 




-.46 



19. Cold-Warm 


A 


20. Small -Large 


P 


21. Soft -Rough 


none 


22. Soft-Hard 


P 


23. Wonderful -Awful 


none 


24. Thin-Fat 


none 


25. Smart-Stupid 


none 



.64 

.58 

.56 

.55 

-.49 

.48 

.42 



26. 


Safe-Dangerous 


none 


27. 


Clean-Dirty 


E 


28. 


Unkind-Kl nd 


none 


29. 


Unhealthy-Healthy 


none 


30. 


Unfriendly-Friendly 


none 


31. 


Pretty-Ugly 


E 


32. 


Exciting-Dull 


none 


33. 


Dumb-lntel 1 igent 


none 



-.72 

-.68 

.67 

.64 

.57 

-.48 

-.40 

.40 .64 



TABLE 6. (continued) 



Results of Second Factor Analysis With Rotation 
of Five Factors 



Scale Name 



Loading In Factor 

Previous Studies* 1 2 3 4 5 



34. Exciting-Boring 

35. Mean-Nice 

36. Square-Round 

37. Cowardly-Brave 

38. Rough -Smooth 

39. Low-High 

40. Young-Old 

41. Little-Big 

42. Dull-Bright 



Eigenvalue 

Percent of Total Variance 



none 


-.63 

.63 


none 


novel ty- 


.48 


real 1 ty 
E-P 


.46 


E-P-A 


.45 


E 


.45 


E-P-A 


-.44 


P 


.41 


none 


.41 



8.04 5.67 3.97 3.25 2.95 
11 8 6 4 4 



*The previous studies were by Osgood, Sucl and Tannenbaum (1957) 
and D) Vesta (1966) . 
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